block violent live stream
Facebook trained its AI to block violent live streams after Christchurch attacks
Facebook trained its artificial intelligence systems to detect and block any future attempt to livestream a shooting spree with "police/military body cams footage," and other violent material, in the aftermath of the Christchurch terror attack. The emergency exercise – detailed in corporate papers leaked by whistleblower Frances Haugen – followed the March 2019 mass murder in the New Zealand city, described internally as "a watershed moment" for the Facebook Live video service. The white supremacist attacker was able to broadcast a 17-minute live stream of the attack on two mosques that was not detected by the company's systems, allowing it to be swiftly replicated online. "It was clear that Live was a vulnerable surface which can be repurposed by bad actors to cause societal harm," the leaked review stated. "Since this event, we've faced international media pressure and have seen regulatory and legal risks increase on Facebook increase considerably."